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INTERNATIONAL PRELIMINARY EXAMINATION REPORT 



International application Nq. 
PCT/SG2002/000060 



Basis of the report 



1 . With regard to the elements of the international application:* 
|~| the international application as originally filed. 

|~X~1 the description, pages 1-12 as originally filed, 

pages , filed with the demand, 
• pages , received on with the letter of 
[x| declaims, pages 14,16 as originally filed, 

pages , as amended (together with any statement) under Article 19, 

pages , filed with the demand, 

pages 13,15,17 received on 7 July 2004 with the letter of 7 Jury 2004 
fx] the drawings, pages 1/5-5/5 as originally filed, 

pages , filed with the demand, 

pages , received on with the letter of 
[ | the sequence listing part of the description: . 
\. pages , as originally filed 

pages 9 filed with the demand 

pages , received on with the letter of 

2. With regard to me language, all the elements marked above were available or furnished to mis Authority in the language in 
which me international application was. filed, unjess otherwise indicated under this item. 

These elements were available or furnished to this Authority in the following language which is: 

j"| the language of a translation furnished for me purposes of international search (under Rule 23.1 (b)). 

[ | the language of publication of me mtcrnational application (under Rule 48.3(b)), 

[n the language of the translation furnished for the purposes of international prelimmary examniation (under Rules 55-2 
and/or 55.3). 

3. With regard to any nucleotide and/or amino acid sequence disclosed in the international application, the international 

preliminary examination was carried out on the basis of the sequence listing: 
| | contained in the international application in written form. 
j | filed together with the international application in computer readable form. 
| | furnished subsequently to this Authority in written form. 
| | furnished subsequently to this Authority in computer readable fomx 

| | The statement that the subsequently frmished written sequence listing does not go beyond the disclosure in the 

international application as filed has been furnished. 
| ] The statement that the information recorded in computer readable form is identical to the written sequence listing has 

been furnished 
| | The amendments have resulted in the cancellation of: 

| | the description, pages 
| | the claims, Nos. 
P"] me drawings, sheets/fig. 
[H This report has been established as if (some of) the amendments had not been made, since they have been considered to 
go beyond the disclosure as filed, as indicated in the Supplemental Box (Rule 70.2(c)) »» 



♦ Replacement sheet* which have been Jumished to the receiving Office in response to an invention under Article 14 are referred to in this 
report as "originally fded* and are not annexed to this report since they do not contain amendments (Rules 70A6and 70.17). 

*• replacement sheet containing such amendments must be referred to under Item 1 and annexed to this report 
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V. Reasoned statement nno*r Article 35(2) with regard to novelty, inventive step or industrial applicability; citations 
and explanations supporting such statement 



1. Statement 



Novelty (N) 


Claims 


1-37 


YES 




Claims 




NO 


Inventive step (IS) 


Claims 


1-37 


YES 




Claims 




NO 


Industrial applicability (IA) 


Claims 


1-37 


YES 




Claims 




NO 



2. Citations and explanations (Role 70.7) 

Dl EP 806739 Bl (LUCENT TECHNOLOGIES INC) 22 January 2003 (A level published 12.1 1.1997) 
0v) New Citations 

1>2 Wen J. et al. "Face recognition method based on virtual sample" 29 October to 1 1 November 2001 ICE 2001. 

International Conference on Info-tech and Info-net 2001 
D3 Beymer, D. "Face recognition from one example view" 20-23 June 1995 

IEEE Proceedings Fifth International Conference on Computer Vision 

Novelty (N) 

Dl is considered the closest prior art identified in the ISR, and discloses face recognition using DCT-based 
feature vectors. The method of matching a given object with a plurality of known objects uses a database and a 
corresponding codebook. Claim 1 (of the present application) defines a face recognition system including 
registering a persons actual face (also creating a plurality of face prototypes). Therefore claim 1 is novel in light 
ofDL ^ . 

D2 discloses virtual faces and a face recognition algorithm. D2 also discloses (explicitly) that the virtual faces 
represent different orientations (or poses). D2 describes a face feature dependent method for generating the 
virtual faces, wherein the actual face image must be at a known pose . The present claims do not restrict the 
actual face image to a known pose, which confers novelty on the claims in view of D2. 

D3 also discloses fece recognition mduding virtual views of faces that are based on a single exa mple view. The 
views include a standard pose and transformed poses. However, similar to Dl and D2 a the actual face image is 
not normalized prior to prototype faces being generated therefrom during image registration. Consequently the 
method is new because although the citations mention normalization of the novel face (ie. the sample to be 
compared) they do not disclose normalization of and transformation of the actual face prior to registration in the 
database (ie. to generate and store the virtual views in the database). D3 requires one real view at a known pose, 
and the present claims define that the image of the persons actual face is normalized by applying at least one of 
translational, rotational and scalar transformations. This difference confers novelty on the claims- 



Inventive step (IS) 

In section 3.2.1 of D3 it is suggested to use normalized correlation with example templates. In contrast, the 
applicant's invention seeks to obtain a good reference database by correcting image errors via normalization 
during registration and creation of the database, instead of during the face recognition stage. 
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INTERNATIONAL PRELIMINARY EXAMINATION REPORT 



International application No. 
PCT/SG2OO2/O0OG6O 



Supplemental Box 

(To be used when the space in any of the preceding boxes is not sufficient) 



Continuation of Box V (Inventive Step) 

The new method would not be obvious in light of D3 for example, where a similar normalization occurs (see section 
3.2.1 and Figure 2). The parallel deformation is performed after feature extraction on the input view. The input is 
repetitively matched against all example views of all people. Matching involves a geometrical registration step and 
correlation. The geometrical registration involves transformation of the input view (using extracted features suchas 
iris and nose lobe). The D3 database contains 15 real example views of each person to handle pose, mvanance. The one 
real view and multiple virtual views of the face to be recognised are then compared with the multiple real view 
information previously stored in the database. 

A person having ordinary skill would not be lead to normalize the actual face images before putting them in the 
database (as presently defined in the amended claims). D3 teaches to store multiple real views to handle pose 
nvvariance. None of the other citations suggest correcting the database using normalization (as part of the image 
Q^stration procedure). 

The term "face prototypes" has been interpreted to imply that a previous step including registering a person's actual 
face wherein an imaee of the actual face is captured and synthesized to create a plurality of face prototypes, and 
wherein the face prototypes are stored for later analysis and comparison with a captured image to be recognised or 
verified has been part of the creation process for the face prototypes. This interpretation is based on page 3 lines 2-7 
and reading the description as a whole. Hence the claims are interpreted to define that the face prototypes are created 
from one real image and are stored for later use. 

All of the claims satisfy PCT requirements for inventive step. 



Industrial applicability OA) 



The claims have an industrial application (ie. face recognition database correction). 
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CLAIMS: 



7SGO2/00O60 
Received 07 July 2004 



1. A face recognition and/or verification system including the step of 
Registering a persons actual face wherein an image of said actual face is 
captured and synthesized to create a plurality of face prototypes, wherein said 
5 face prototypes are stored for later analysis and comparison with a captured 
Image, to be recognised or verified, and wherein at least one of translations! , 
rotational and scalar transformations is applied to the captured actual face 
image for normalization thereof. 

10 .2. The system as claimed In claim 1 wherein said face prototypes 
represent possible appearances of said actual face under various lighting 
conditions, varying facia! expressions, varying facial orientations, and/or 
modeling errors. 

15 3, The system as dalmed in claim 1, wherein comparison of said face 
prototypes and captured image uses a face matching algorithm. 

4. The system as claimed in claim 1, wherein comparison of said face 
prototypes and captured image uses face templates or feature vectors, 

20 

5. The system as claimed in any preceding claim, wherein synthesizing of 
said actual face Includes normalising said actual face image based on the 
spatial relationship between at least two features of the actual face image. 

25 6. The system as claimed in claim 5, wherein normalising includes 
rotating said actual face image to bring eyes of said actual face Image to a 
horizontal plane. 

7. The system as claimed in claim 5 or claim 6, wherein normalising 
30 Includes scaling said actual face image such that the eyes are a fixed 

- distance apart. 

8. The system as claimed In claim 7, wherein said eyes are fixed at 60 
pixels apart. 

35 
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19. The system as claimed in dalm 1 6, wherein said photometric transform 
includes at least one of: 

algorithmic function, exponential stretch, vertical shadow, 
horizontal shadow and differentiating image. 

20. A facial prototype syndesis system wherein an image of a persons 
actual face is Initially normalized by applying at least one of transJationaJ, 
rotational and scalar transformations thereto for subsequently creating a 
plurality of face . prototypes, said face prototypes representing possible 
appearances of said actual face under various lighting conditions, varying 
facial expressions, varying -facial orientations, and/or modeling errors, and 
wherein said face prototypes am stored for later use 

21 . The system as claimed in daim 20, wherein said actual face image is 
normalized prior to creating said face prototypes based on the spatial 
relationship between at least two features of the actual face image. 

22. The system as claimed in daim . 21, wherein normalising includes 
rotating said actual face image to bring eyes of said actual face image to a 
horizontal plane. 

23. The system as claimed in claim 21 or claim 22, wherein normalising 
includes scaling said actual face image such that the eyes are a fixed 
distance apart 

24. The system as claimed in dalm 23, wherein said eyes are fixed at 50 
pixels apart 

26. The system as claimed in any one of claims 20 to 24, wherein the area 
above the persons eyebrows and below the persons mouth is not 
synthesized. 

26. The system as claimed in any one of daims 20 to 25, wherein to create 
said face prototypes said system determines alternative positions for each 
eye so as to compensate for possible errors. 
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9. The system as claimed in any preceding claim wherein the area above the 
persons eyebrows and below the persons mouth is not synthesized. 

10. The system as claimed in any preceding claim wherein synthesizing of 
said actual face includes determining alternative positions for each eye so as to 
compensate for possible errors. 

11. The system as claimed in claim 10, wherein five alternative positions are 
determined for each eye. 

12. The system as claimed in any preceding claim wherein synthesizing of 
said actual face includes applying at least one predefined lighting mask to said 
actual face image. 

13. The system as claimed in claim 12, wherein three to 16 predefined lighting 
masks are used. 

14. The system as claimed in any preceding claim wherein synthesizing of 
said actual face includes applying at least one predefined warping mask to said 
actual face image. 

15. The system as claimed in claim 14, wherein 25 predefined warping masks 
are used. 

16. The system as claimed in claim 12 or claim 13, wherein said at least one 
lighting mask includes photometric transform. 

17. The system as claimed in claim 14 or claim 15, wherein said at least one 
warping mask includes geometric transform. 



18. The system as claimed in claim 17, wherein said geometric transform is 
estimated using optical flow estimation. 
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27. The system as claimed in claim 26, wherein five alternative positions are 
determined for each eye. 

5 28. The system as claimed in any one of claims 20 to 27 wherein to create 
said face prototypes said system applies at least one predefined lighting mask to 
said actual face image. 

29. The system as claimed in claim 28, wherein three to 16 predefined lighting 
10 masks are used. 

30. The system as claimed in one of claims 20 to 29 wherein to create said 
face prototypes said system applies at least one predefined warping mask to said 
actual face image. 

15 

31. The system as claimed in claim 30, wherein 25 predefined warping masks 
are used. 

32. The system as claimed in daim 28 or claim 29, wherein said at least one 
20 lighting mask includes photometric transform. 

33. The system as claimed in claim 30 or claim 31, wherein said at least one 
warping mask includes geometric transform. 

25 34. The system as claimed in claim 33, wherein said geometric transform is 
estimated using optical flow estimation. 

35. The system as claimed in claim 32, wherein said photometric transform 
includes at least one of: 
30 algorithmic function, exponential stretch, vertical shadow, horizontal 

shadow and differentiating image. 
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36. The system as claimed in claim 20 t wherein said face prototypes are 
generated by applying photometric and/or geometric transforms to said 
image. 

5 

37. A facial prototype synthesis system wherein an image* of a persons 
actual face is normalised by applying at least one of tmnslational, rotational 
and scalar transformations to the captured actual face Image, and 
synthesized by determining possible alternative eye positions and applying at 

10 feast one mask to said Image to create a plurality of face prototypes, and 
wherein said face prototypes represent possible appearances of said actual 
face under various lighting conditions, varying fecial expressions, varying 
( facial orientations, and/or modeling errors. 
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